Electronic device for processing audio data and method for operating same

ABSTRACT

An electronic device according to various embodiments includes a camera; a display; a communication module supporting Bluetooth communication; and a processor, wherein the processor is configured to: establish at least one communication link with a plurality of external electronic devices through the communication module; transmit a first signal indicating an occurrence of an event using the camera to at least one of the plurality of external electronic devices through the at least one communication link; receive audio data corresponding to sound acquired by each of the plurality of external electronic devices, from each of the plurality of external electronic devices in predetermined time periods through the at least one communication link in a state in which the plurality of external electronic devices are worn; and synchronize the audio data with video acquired using the camera and store the synchronized data, based on time and an order at which each of the plurality of external electronic devices acquires the sound.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a National Phase Entry of PCT InternationalApplication No. PCT/KR2021/009906, which was filed on Jul. 29, 2021, andclaims priority to Korean Patent Application No. 10-2020-0097681 whichwas filed on Aug. 4, 2021 in the Korean Intellectual Property Office,the contents of which are incorporated herein by reference.

BACKGROUND 1. Field

Various embodiments relate to an electronic device for processing audiodata and a method for operating the same.

2. Description of the Related Art

In line with development of wireless communication technologies, anelectronic device can communicate with another electronic device throughvarious wireless communication technologies. Bluetooth communicationtechnology refers to a short-range wireless communication technologythat enables electronic devices to connect with each other and toexchange data or information. In addition, the Bluetooth communicationtechnology may include a legacy (or classic) network technology or aBluetooth low energy (BLE) network, and may have a topology in variousconnection types, such as a piconet or a scatternet. By using theBluetooth communication technology, electronic devices can share datawith each other by consuming a small amount of power. Such Bluetoothtechnology may be used to connect external wireless communicationdevices and to transmit audio data regarding contents executed by anelectronic device to an external wireless communication device such thatthe external wireless communication device can process the audio dataand output the same to the user. There has recently been widespread useof wireless earphones using the Bluetooth communication technology.

SUMMARY

An electronic device (for example, a smartphone) including a camera mayperform a function for capturing moving images or a video communicationfunction. For example, when capturing a moving image with thesmartphone, the user may record the ambient sound through a microphoneincluded in the smartphone. if the user holds the smartphone by handwhile capturing the moving image, a part of the microphone included inthe smartphone may fail to properly record the ambient sound due to theuser's hand. The sound acquired through the microphone of the smartphonemay differ from the sound actually heard by the user, due to themismatch between the position of the microphone and the position of theuser's ears. That is, the sound of the moving image captured by thesmartphone may not match with the sound heard by the user, therebydegrading the stereoscopic feeling of the sound or the fidelity thereof.In addition, the smartphone may fail to acquire stereo audio dataregarding the ambient sound.

In this connection, the user may acquire the ambient sound by a separatemicrophone other than the smartphone. For example, if an externalmicrophone is connected to the smartphone, the ambient sound may beacquired through the external microphone when capturing a moving image.However, even if the external microphone is used, the smartphone mayfail to acquire stereo audio corresponding to the ambient sound. Inaddition, if the position of the external microphone does not match withthe position of the user's ears, the audio data acquired by thesmartphone may differ from the sound actually heard by the user. Thatis, even if a separate microphone is used, the smartphone may fail toacquire stereo audio data regarding the ambient sound.

Various embodiments may provide an electronic device and a method foroperating the same, wherein, while multiple external electronic devicesare worn by the user, audio data acquired by each of the multipleexternal electronic devices is received, and the audio data issynchronized with the video acquired through the camera of theelectronic device and then stored.

An electronic device according to various embodiments may include acamera; a display; a communication module configured to supportBluetooth communication; and a processor, wherein the processor isconfigured to establish at least one communication link with a pluralityof external electronic devices through the communication module;transmit a first signal indicating an occurrence of an event using thecamera to at least one of the plurality of external electronic devicesthrough the at least one communication link; receive audio datacorresponding to sound acquired by each of the plurality of externalelectronic devices, from each of the plurality of external electronicdevices in predetermined time periods through the at least onecommunication link in a state in which the plurality of externalelectronic devices are worn; and synchronize the audio data with videoacquired using the camera and store the synchronized audio data, basedon time and an order at which each of the plurality of externalelectronic devices acquires the sound.

A method of operating an electronic device according to variousembodiments may include establishing at least one communication linkwith a plurality of external electronic devices; transmitting a firstsignal indicating an occurrence of an event using a camera included inthe electronic device to at least one of the plurality of externalelectronic devices through the at least one communication link;receiving audio data corresponding to sound acquired by each of theplurality of external electronic devices, from each of the plurality ofexternal electronic devices in predetermined time periods through the atleast one communication link in a state in which the plurality ofexternal electronic devices are worn; and synchronizing the audio datawith video acquired using the camera and storing the synchronized audiodata, based on time and an order at which each of the plurality ofexternal electronic devices acquires the sound.

An electronic device according to various embodiments may include asensor; at least one microphone; a communication module configured tosupport Bluetooth communication; and a processor, wherein the processoris configured to establish a communication link with external electronicdevices through the communication module; receive a first signalindicating an occurrence of an event of acquiring video using a cameraof the external electronic device from the external electronic devicethrough the communication link; acquiring audio data corresponding toambient sound through the at least one microphone in a state in whichthe electronic device is worn; and transmit the audio data to theexternal electronic device in a predetermined time period through thecommunication module.

An electronic device according to various embodiments may synchronizeaudio data acquired by each of multiple external electronic devices,while the multiple external electronic devices are worn, with video datasuch that the ambient sound of the space in which the video is capturedcan be processed clearly.

Before undertaking the DETAILED DESCRIPTION below, it may beadvantageous to set forth definitions of certain words and phrases usedthroughout this patent document the terms “include” and “comprise,” aswell as derivatives thereof, mean inclusion without limitation; the term“or,” is inclusive, meaning and/or; the phrases “associated with” and“associated therewith,” as well as derivatives thereof, may mean toinclude, be included within, interconnect with, contain, be containedwithin, connect to or with, couple to or with, be communicable with,cooperate with, interleave, juxtapose, be proximate to, be bound to orwith, have, have a property of, or the like; and the term “controller”means any device, system or part thereof that controls at least oneoperation, such a device may be implemented in hardware, firmware orsoftware, or some combination of at least two of the same. It should benoted that the functionality associated with any particular controllermay be centralized or distributed, whether locally or remotely.

Moreover, various functions described below can be implemented orsupported by one or more computer programs, each of which is formed fromcomputer readable program code and embodied in a computer readablemedium. The terms “application” and “program” refer to one or morecomputer programs, software components, sets of instructions,procedures, functions, objects, classes, instances, related data, or aportion thereof adapted for implementation in a suitable computerreadable program code. The phrase “computer readable program code”includes any type of computer code, including source code, object code,and executable code. The phrase “computer readable medium” includes anytype of medium capable of being accessed by a computer, such as readonly memory (ROM), random access memory (RAM), a hard disk drive, acompact disc (CD), a digital video disc (DVD), or any other type ofmemory. A “non-transitory” computer readable medium excludes wired,wireless, optical, or other communication links that transporttransitory electrical or other signals. A non-transitory computerreadable medium includes media where data can be permanently stored andmedia where data can be stored and later overwritten, such as arewritable optical disc or an erasable memory device.

Definitions for certain words and phrases are provided throughout thispatent document, those of ordinary skill in the art should understandthat in many, if not most instances, such definitions apply to prior, aswell as future uses of such defined words and phrases.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of the disclosurewill be more apparent from the following detailed description taken inconjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram illustrating an electronic device in a networkenvironment according to various embodiments;

FIGS. 2A, 2B, and 2C are schematic block diagrams illustrating anelectronic system according to various embodiments;

FIG. 3 is a flowchart illustrating a method of operating an electronicdevice, according to various embodiments;

FIG. 4 is a flowchart illustrating a method of shooting a video by anelectronic device using a plurality of external electronic devicesaccording to various embodiments;

FIG. 5 is a flowchart illustrating a method of transmitting audio datato an electronic device by a first external electronic device accordingto various embodiments;

FIG. 6 is a flowchart illustrating a method of shooting a video by anelectronic device using a plurality of external electronic devicesaccording to various embodiments;

FIG. 7 is a diagram illustrating a method of receiving audio data from aplurality of external electronic devices by an electronic deviceaccording to various embodiments;

FIG. 8A is a diagram illustrating a method of receiving audio data froma plurality of external electronic devices by an electronic deviceaccording to various embodiments, and FIG. 8B is a diagram illustratingmethod of receiving audio data from a plurality of external electronicdevices by an electronic device according to various embodiments;

FIG. 9A is a diagram illustrating a method of receiving audio data froma plurality of external electronic devices by an electronic deviceaccording to various embodiments, and FIG. 9B is a diagram illustratinga method of receiving audio data from a plurality of external electronicdevices by an electronic device according to various embodiments;

FIG. 10 is a diagram illustrating a method of receiving audio data froma plurality of external electronic devices by an electronic deviceaccording to various embodiments;

FIG. 11 is a diagram illustrating a method of synchronizing video andaudio data by an electronic device, according to various embodiments;and

FIGS. 12A, 12B, 12C, 12D, and 12E are user interfaces illustrating amethod of shooting a video by an electronic device using a plurality ofexternal electronic devices according to various embodiments.

DETAILED DESCRIPTION

FIGS. 1 through 12E, discussed below, and the various embodiments usedto describe the principles of the present disclosure in this patentdocument are by way of illustration only and should not be construed inany way to limit the scope of the disclosure. Those skilled in the artwill understand that the principles of the present disclosure may beimplemented in any suitably arranged system or device.

FIG. 1 is a block diagram illustrating an electronic device 101 in anetwork environment 100 according to various embodiments. Referring toFIG. 1, the electronic device 101 in the network environment 100 maycommunicate with an electronic device 102 via a first network 198 (e.g.,a short-range wireless communication network), or at least one of anelectronic device 104 or a server 108 via a second network 199 (e.g., along-range wireless communication network). According to an embodiment,the electronic device 101 may communicate with the electronic device 104via the server 108. According to an embodiment, the electronic device101 may include a processor 120, memory 130, an input module 150, asound output module 155, a display module 160, an audio module 170, asensor module 176, an interface 177, a connecting terminal 178, a hapticmodule 179, a camera module 180, a power management module 188, abattery 189, a communication module 190, a subscriber identificationmodule (SIM) 196, or an antenna module 197. In some embodiments, atleast one of the components (e.g., the connecting terminal 178) may beomitted from the electronic device 101, or one or more other componentsmay be added in the electronic device 101. In some embodiments, some ofthe components (e.g., the sensor module 176, the camera module 180, orthe antenna module 197) may be implemented as a single component (e.g.,the display module 160).

The processor 120 may execute, for example, software (e.g., a program140) to control at least one other component (e.g., a hardware orsoftware component) of the electronic device 101 coupled with theprocessor 120, and may perform various data processing or computation.According to one embodiment, as at least part of the data processing orcomputation, the processor 120 may store a command or data received fromanother component (e.g., the sensor module 176 or the communicationmodule 190) in volatile memory 132, process the command or the datastored in the volatile memory 132, and store resulting data innon-volatile memory 134. According to an embodiment, the processor 120may include a main processor 121 (e.g., a central processing unit (CPU)or an application processor (AP)), or an auxiliary processor 123 (e.g.,a graphics processing unit (GPU), a neural processing unit (NPU), animage signal processor (ISP), a sensor hub processor, or a communicationprocessor (CP)) that is operable independently from, or in conjunctionwith, the main processor 121. For example, when the electronic device101 includes the main processor 121 and the auxiliary processor 123, theauxiliary processor 123 may be adapted to consume less power than themain processor 121, or to be specific to a specified function. Theauxiliary processor 123 may be implemented as separate from, or as partof the main processor 121.

The auxiliary processor 123 may control at least some of functions orstates related to at least one component (e.g., the display module 160,the sensor module 176, or the communication module 190) among thecomponents of the electronic device 101, instead of the main processor121 while the main processor 121 is in an inactive (e.g., sleep) state,or together with the main processor 121 while the main processor 121 isin an active state (e.g., executing an application). According to anembodiment, the auxiliary processor 123 (e.g., an image signal processoror a communication processor) may be implemented as part of anothercomponent (e.g., the camera module 180 or the communication module 190)functionally related to the auxiliary processor 123. According to anembodiment, the auxiliary processor 123 (e.g., the neural processingunit) may include a hardware structure specified for artificialintelligence model processing. An artificial intelligence model may begenerated by machine learning. Such learning may be performed, e.g., bythe electronic device 101 where the artificial intelligence is performedor via a separate server (e.g., the server 108). Learning algorithms mayinclude, but are not limited to, e.g., supervised learning, unsupervisedlearning, semi-supervised learning, or reinforcement learning. Theartificial intelligence model may include a plurality of artificialneural network layers. The artificial neural network may be a deepneural network (DNN), a convolutional neural network (CNN), a recurrentneural network (RNN), a restricted boltzmann machine (RBM), a deepbelief network (DBN), a bidirectional recurrent deep neural network(BRDNN), deep Q-network or a combination of two or more thereof but isnot limited thereto. The artificial intelligence model may, additionallyor alternatively, include a software structure other than the hardwarestructure.

The memory 130 may store various data used by at least one component(e.g., the processor 120 or the sensor module 176) of the electronicdevice 101. The various data may include, for example, software (e.g.,the program 140) and input data or output data for a command relatedthererto. The memory 130 may include the volatile memory 132 or thenon-volatile memory 134.

The program 140 may be stored in the memory 130 as software, and mayinclude, for example, an operating system (OS) 142, middleware 144, oran application 146.

The input module 150 may receive a command or data to be used by anothercomponent (e.g., the processor 120) of the electronic device 101, fromthe outside (e.g., a user) of the electronic device 101. The inputmodule 150 may include, for example, a microphone, a mouse, a keyboard,a key (e.g., a button), or a digital pen (e.g., a stylus pen).

The sound output module 155 may output sound signals to the outside ofthe electronic device 101. The sound output module 155 may include, forexample, a speaker or a receiver. The speaker may be used for generalpurposes, such as playing multimedia or playing record. The receiver maybe used for receiving incoming calls. According to an embodiment, thereceiver may be implemented as separate from, or as part of the speaker.

The display module 160 may visually provide information to the outside(e.g., a user) of the electronic device 101. The display module 160 mayinclude, for example, a display, a hologram device, or a projector andcontrol circuitry to control a corresponding one of the display,hologram device, and projector. According to an embodiment, the displaymodule 160 may include a touch sensor adapted to detect a touch, or apressure sensor adapted to measure the intensity of force incurred bythe touch.

The audio module 170 may convert a sound into an electrical signal andvice versa. According to an embodiment, the audio module 170 may obtainthe sound via the input module 150, or output the sound via the soundoutput module 155 or a headphone of an external electronic device (e.g.,an electronic device 102) directly (e.g., wiredly) or wirelessly coupledwith the electronic device 101.

The sensor module 176 may detect an operational state (e.g., power ortemperature) of the electronic device 101 or an environmental state(e.g., a state of a user) external to the electronic device 101, andthen generate an electrical signal or data value corresponding to thedetected state. According to an embodiment, the sensor module 176 mayinclude, for example, a gesture sensor, a gyro sensor, an atmosphericpressure sensor, a magnetic sensor, an acceleration sensor, a gripsensor, a proximity sensor, a color sensor, an infrared (IR) sensor, abiometric sensor, a temperature sensor, a humidity sensor, or anilluminance sensor.

The interface 177 may support one or more specified protocols to be usedfor the electronic device 101 to be coupled with the external electronicdevice (e.g., the electronic device 102) directly (e.g., wiredly) orwirelessly. According to an embodiment, the interface 177 may include,for example, a high definition multimedia interface (HDMI), a universalserial bus (USB) interface, a secure digital (SD) card interface, or anaudio interface.

A connecting terminal 178 may include a connector via which theelectronic device 101 may be physically connected with the externalelectronic device (e.g., the electronic device 102). According to anembodiment, the connecting terminal 178 may include, for example, a HDMIconnector, a USB connector, a SD card connector, or an audio connector(e.g., a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanicalstimulus (e.g., a vibration or a movement) or electrical stimulus whichmay be recognized by a user via his tactile sensation or kinestheticsensation. According to an embodiment, the haptic module 179 mayinclude, for example, a motor, a piezoelectric element, or an electricstimulator.

The camera module 180 may capture a still image or moving images.According to an embodiment, the camera module 180 may include one ormore lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to theelectronic device 101. According to one embodiment, the power managementmodule 188 may be implemented as at least part of, for example, a powermanagement integrated circuit (PMIC).

The battery 189 may supply power to at least one component of theelectronic device 101. According to an embodiment, the battery 189 mayinclude, for example, a primary cell which is not rechargeable, asecondary cell which is rechargeable, or a fuel cell.

The communication module 190 may support establishing a direct (e.g.,wired) communication channel or a wireless communication channel betweenthe electronic device 101 and the external electronic device (e.g., theelectronic device 102, the electronic device 104, or the server 108) andperforming communication via the established communication channel. Thecommunication module 190 may include one or more communicationprocessors that are operable independently from the processor 120 (e.g.,the application processor (AP)) and supports a direct (e.g., wired)communication or a wireless communication. According to an embodiment,the communication module 190 may include a wireless communication module192 (e.g., a cellular communication module, a short-range wirelesscommunication module, or a global navigation satellite system (GNSS)communication module) or a wired communication module 194 (e.g., a localarea network (LAN) communication module or a power line communication(PLC) module). A corresponding one of these communication modules maycommunicate with the external electronic device via the first network198 (e.g., a short-range communication network, such as Bluetooth™,wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA))or the second network 199 (e.g., a long-range communication network,such as a legacy cellular network, a 5G network, a next-generationcommunication network, the Internet, or a computer network (e.g., LAN orwide area network (WAN)). These various types of communication modulesmay be implemented as a single component (e.g., a single chip), or maybe implemented as multi components (e.g., multi chips) separate fromeach other. The wireless communication module 192 may identify andauthenticate the electronic device 101 in a communication network, suchas the first network 198 or the second network 199, using subscriberinformation (e.g., international mobile subscriber identity (IMSI))stored in the subscriber identification module 196.

The wireless communication module 192 may support a 5G network, after a4G network, and next-generation communication technology, e.g., newradio (NR) access technology. The NR access technology may supportenhanced mobile broadband (eMBB), massive machine type communications(mMTC), or ultra-reliable and low-latency communications (URLLC). Thewireless communication module 192 may support a high-frequency band(e.g., the mmWave band) to achieve, e.g., a high data transmission rate.The wireless communication module 192 may support various technologiesfor securing performance on a high-frequency band, such as, e.g.,beamforming, massive multiple-input and multiple-output (massive MIMO),full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, orlarge scale antenna. The wireless communication module 192 may supportvarious requirements specified in the electronic device 101, an externalelectronic device (e.g., the electronic device 104), or a network system(e.g., the second network 199). According to an embodiment, the wirelesscommunication module 192 may support a peak data rate (e.g., 20 Gbps ormore) for implementing eMBB, loss coverage (e.g., 164 dB or less) forimplementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each ofdownlink (DL) and uplink (UL), or a round trip of 1 ms or less) forimplementing URLLC.

The antenna module 197 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 101. According to an embodiment, the antenna module197 may include an antenna including a radiating element composed of aconductive material or a conductive pattern formed in or on a substrate(e.g., a printed circuit board (PCB)). According to an embodiment, theantenna module 197 may include a plurality of antennas (e.g., arrayantennas). In such a case, at least one antenna appropriate for acommunication scheme used in the communication network, such as thefirst network 198 or the second network 199, may be selected, forexample, by the communication module 190 (e.g., the wirelesscommunication module 192) from the plurality of antennas. The signal orthe power may then be transmitted or received between the communicationmodule 190 and the external electronic device via the selected at leastone antenna. According to an embodiment, another component (e.g., aradio frequency integrated circuit (RFIC)) other than the radiatingelement may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form ammWave antenna module. According to an embodiment, the mmWave antennamodule may include a printed circuit board, a RFIC disposed on a firstsurface (e.g., the bottom surface) of the printed circuit board, oradjacent to the first surface and capable of supporting a designatedhigh-frequency band (e.g., the mmWave band), and a plurality of antennas(e.g., array antennas) disposed on a second surface (e.g., the top or aside surface) of the printed circuit board, or adjacent to the secondsurface and capable of transmitting or receiving signals of thedesignated high-frequency band.

At least some of the above-described components may be coupled mutuallyand communicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, general purposeinput and output (GPIO), serial peripheral interface (SPI), or mobileindustry processor interface (MIPI)).

According to an embodiment, commands or data may be transmitted orreceived between the electronic device 101 and the external electronicdevice 104 via the server 108 coupled with the second network 199. Eachof the electronic devices 102 or 104 may be a device of a same type as,or a different type, from the electronic device 101. According to anembodiment, all or some of operations to be executed at the electronicdevice 101 may be executed at one or more of the external electronicdevices 102, 104, or 108. For example, if the electronic device 101should perform a function or a service automatically, or in response toa request from a user or another device, the electronic device 101,instead of, or in addition to, executing the function or the service,may request the one or more external electronic devices to perform atleast part of the function or the service. The one or more externalelectronic devices receiving the request may perform the at least partof the function or the service requested, or an additional function oran additional service related to the request, and transfer an outcome ofthe performing to the electronic device 101. The electronic device 101may provide the outcome, with or without further processing of theoutcome, as at least part of a reply to the request. To that end, acloud computing, distributed computing, mobile edge computing (MEC), orclient-server computing technology may be used, for example. Theelectronic device 101 may provide ultra low-latency services using,e.g., distributed computing or mobile edge computing. In anotherembodiment, the external electronic device 104 may include aninternet-of-things (IoT) device. The server 108 may be an intelligentserver using machine learning and/or a neural network. According to anembodiment, the external electronic device 104 or the server 108 may beincluded in the second network 199. The electronic device 101 may beapplied to intelligent services (e.g., smart home, smart city, smartcar, or healthcare) based on 5G communication technology or IoT-relatedtechnology.

The electronic device according to various embodiments may be one ofvarious types of electronic devices. The electronic devices may include,for example, a portable communication device (e.g., a smartphone), acomputer device, a portable multimedia device, a portable medicaldevice, a camera, a wearable device, or a home appliance. According toan embodiment of the disclosure, the electronic devices are not limitedto those described above.

It should be appreciated that various embodiments of the presentdisclosure and the terms used therein are not intended to limit thetechnological features set forth herein to particular embodiments andinclude various changes, equivalents, or replacements for acorresponding embodiment. With regard to the description of thedrawings, similar reference numerals may be used to refer to similar orrelated elements. It is to be understood that a singular form of a nouncorresponding to an item may include one or more of the things, unlessthe relevant context clearly indicates otherwise. As used herein, eachof such phrases as “A or B,” “at least one of A and B,” “at least one ofA or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least oneof A, B, or C,” may include any one of, or all possible combinations ofthe items enumerated together in a corresponding one of the phrases. Asused herein, such terms as “1st” and “2nd,” or “first” and “second” maybe used to simply distinguish a corresponding component from another,and does not limit the components in other aspect (e.g., importance ororder). It is to be understood that if an element (e.g., a firstelement) is referred to, with or without the term “operatively” or“communicatively”, as “coupled with,” “coupled to,” “connected with,” or“connected to” another element (e.g., a second element), it means thatthe element may be coupled with the other element directly (e.g.,wiredly), wirelessly, or via a third element.

As used in connection with various embodiments of the disclosure, theterm “module” may include a unit implemented in hardware, software, orfirmware, and may interchangeably be used with other terms, for example,“logic,” “logic block,” “part,” or “circuitry”. A module may be a singleintegral component, or a minimum unit or part thereof, adapted toperform one or more functions. For example, according to an embodiment,the module may be implemented in a form of an application-specificintegrated circuit (ASIC).

Various embodiments as set forth herein may be implemented as software(e.g., the program 140) including one or more instructions that arestored in a storage medium (e.g., internal memory 136 or external memory138) that is readable by a machine (e.g., the electronic device 101).For example, a processor (e.g., the processor 120) of the machine (e.g.,the electronic device 101) may invoke at least one of the one or moreinstructions stored in the storage medium, and execute it, with orwithout using one or more other components under the control of theprocessor. This allows the machine to be operated to perform at leastone function according to the at least one instruction invoked. The oneor more instructions may include a code generated by a complier or acode executable by an interpreter. The machine-readable storage mediummay be provided in the form of a non-transitory storage medium. Wherein,the term “non-transitory” simply means that the storage medium is atangible device, and does not include a signal (e.g., an electromagneticwave), but this term does not differentiate between where data issemi-permanently stored in the storage medium and where the data istemporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments ofthe disclosure may be included and provided in a computer programproduct. The computer program product may be traded as a product betweena seller and a buyer. The computer program product may be distributed inthe form of a machine-readable storage medium (e.g., compact disc readonly memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded)online via an application store (e.g., PlayStore™), or between two userdevices (e.g., smart phones) directly. If distributed online, at leastpart of the computer program product may be temporarily generated or atleast temporarily stored in the machine-readable storage medium, such asmemory of the manufacturer's server, a server of the application store,or a relay server.

According to various embodiments, each component (e.g., a module or aprogram) of the above-described components may include a single entityor multiple entities, and some of the multiple entities may beseparately disposed in different components. According to variousembodiments, one or more of the above-described components may beomitted, or one or more other components may be added. Alternatively oradditionally, a plurality of components (e.g., modules or programs) maybe integrated into a single component. In such a case, according tovarious embodiments, the integrated component may still perform one ormore functions of each of the plurality of components in the same orsimilar manner as they are performed by a corresponding one of theplurality of components before the integration. According to variousembodiments, operations performed by the module, the program, or anothercomponent may be carried out sequentially, in parallel, repeatedly, orheuristically, or one or more of the operations may be executed in adifferent order or omitted, or one or more other operations may beadded.

FIG. 2A, 2B, and 2C are schematic block diagrams illustrating anelectronic system according to various embodiments.

Referring to FIGS. 2A and 2B, the electronic system may include anelectronic device 201 and a plurality of external electronic devices(e.g., a first external electronic device 202 and a second externalelectronic device 204). For example, the electronic device 201, thefirst external electronic device 202, and the second external electronicdevice 204 may be implemented in the same or similar manner as or tothat in the electronic device 101 of FIG. 1. For example, the electronicdevice 201 may be implemented as a smartphone. The first externalelectronic device 202 and the second external electronic device 204 maybe implemented with an earphone in a first direction (e.g., an earphoneworn on the right ear) and an earphone in a second direction (e.g., anearphone worn on the left ear). According to various embodiments, thefirst external electronic device 202 and the second external electronicdevice 204 may form a pair, but may not be limited thereto.

According to various embodiments, the electronic device 201 may transmitand receive data to and from the plurality of external electronicdevices 202 and 204. To this end, the electronic device 201 mayestablish a communication link with the plurality of external electronicdevices 202 and 204 using a short-range communication method (e.g., aBluetooth communication method or a BLE communication method). In FIGS.2A and 2B, a method of establishing a communication link through whichthe electronic device 201 transmits and receives data to and from theplurality of external electronic devices 202 and 204 will be described.However, this is only an example, and the technical idea of thedisclosure may not be limited thereto. For example, the electronicdevice 201 may establish a communication link with the plurality ofexternal electronic devices 202 and 204 in various ways.

Referring to FIG. 2A, according to various embodiments, the electronicdevice 201 may establish a communication link (link 1 and link 2) witheach of the plurality of external electronic devices 202 and 204. Forexample, the electronic device 201 may establish a communication link(link 1 and link 2) with each of the external electronic devices 202 and204 using a truly wireless stereo (TWS) plus method, and may transmitand receive data through the communication links (link 1 and link 2).For example, the electronic device 201 may establish a firstcommunication link (link 1) with the first external electronic device202 and a second communication link (link 2) with the second externalelectronic device 204. The electronic device 201 may transmit andreceive data to and from the first external electronic device 202through the first communication link (link 1), and may transmit andreceive data to and from the second external electronic device 204through the second communication link (link 2). According to anembodiment, the electronic device 201 may manage communication resourcesto transmit and receive data to and from the first external electronicdevice 202 or the second external electronic device 204. For example,the electronic device 201 may communicate with the first externalelectronic device 202 or the second external electronic device 204 bydividing a frequency or time.

Referring to FIG. 2B, according to various embodiments, the electronicdevice 201 may transmit and receive data to and from the plurality ofexternal electronic devices 202 and 204 through the first communicationlink (link 1) established by the first external electronic device 202among the plurality of external electronic devices 202 and 204. Forexample, the electronic device 201 may transmit and receive data throughthe first communication link (link 1) established by the first externalelectronic device, using a sniffing method operating in a Bluetoothsniffing topology. To this end, the first external electronic device 202may establish a third communication link (link 3) with the secondexternal electronic device 204. The second external electronic device204 may obtain information on the first communication link (link 1)between the first external electronic device 202 and the electronicdevice 201, from the first external electronic device 202 through thethird communication link (link 3). According to various embodiments, thesecond external electronic device 204 may transmit and receive data toand from the electronic device 201 by sharing the first communicationlink (link 1) with the first external electronic device 202. Forexample, the second external electronic device 204 may directly transmitand receive data to and from the electronic device 201 by sharing thefirst communication link (link 1). However, this is only an example, andthe second external electronic device 204 of the disclosure may transmitand receive data to and from the electronic device 201 by sharing thefirst communication link (link 1) according to various sniffingtopologies. For example, the second external electronic device 204 mayobtain information on the first communication link (link 1) from theelectronic device 201. The second external electronic device 204 mayobtain information on the first communication link (link 1) through athird external electronic device (not shown) (e.g., a cradle) betweenthe first external electronic device 202 and the second externalelectronic device 204. The second external electronic device 204 mayreceive a signal broadcast by the first external electronic device 202to obtain information on the first communication link (link 1).Alternatively, the second external electronic device 204 may receive aconnection request signal sent by the electronic device 201 togetherwith the first external electronic device 202 to obtain information onthe first communication link (link 1).

According to various embodiments, the information on the firstcommunication link (link 1) may include address information (e.g.,Bluetooth address of a master device of the first communication link,Bluetooth address of the electronic device 201, and/or Bluetooth addressof the first external device 201), piconet (or topology) clockinformation (e.g., clock native (CLKN) of the master device of the firstcommunication link), logical transport (LT) address information (forexample information allocated by the master device of the first link),used channel map information, link key information, service discoveryprotocol (SDP) information (e.g., service and/or profile informationrelated to the first communication link), and/or supported featureinformation. The information associated with the first communicationlink may further include, for example, an extended inquiry response(EIR) packet. The EIR packet may include resource control information ofthe first communication link and/or information on a manufacturer. Thesecond external device 204 may determine a hopping channel (or afrequency hopping channel) of the first communication link through theaddress information and the clock information, and may decrypt anencrypted data packet through the link key information. The secondexternal device 204 may generate an access code (or a channel accesscode) and address information (e.g., LT address) corresponding to thefirst communication link based on the information associated with thefirst communication link, and may transmit a response message includingthe generated access code and address information to the electronicdevice 201.

According to various embodiments, the electronic device 201 mayestablish a communication link only with the first external electronicdevice 202. For example, the electronic device 201 may establish acommunication link with one (e.g., the first external electronic device)of the external electronic devices 202 and 204 using a truly wirelessstereo (TWS) method, and may transmit and receive data through thecommunication link. For example, the electronic device 201 may transmitand receive data to and from the first external electronic device 202through a communication link. Also, the electronic device 201 maytransmit and receive data to and from the second external electronicdevice 204 through the first external electronic device 202. In certainembodiments, unlike the sniffing of FIG. 2B, the second externalelectronic device 204 may transmit and receive data via the firstexternal electronic device 202 in order to transmit and receive data toand from the electronic device 201.

According to the above-described method, the electronic device 201 mayestablish communication links with the plurality of external electronicdevices 202 and 204 and may transmit and receive data. However, this isonly an example, and the technical idea of the disclosure may not belimited thereto.

Referring to FIG. 2C, the electronic device 201 may include a processor220, a memory 230, a display 260, a camera 280, and a communicationmodule 290.

According to various embodiments, the processor 220 may control theoverall operation of the electronic device 201. For example, theprocessor 220 may be implemented in the same or similar manner as or tothat in the processor 120 of FIG. 1.

According to various embodiments, the processor 220 may acquire video(or video data) using the camera 280 (e.g., the camera module 180 ofFIG. 1). For example, the processor 220 may acquire video (or videodata) using the camera 280 in order to shoot a video or perform a videocall. For example, the processor 220 may store the video acquiredthrough the camera 280 in the memory 230 (e.g., the memory 130 of FIG.1).

According to various embodiments, the processor 220 may acquire audio(or audio data) through a microphone in order to shoot a video orperform a video call. According to an embodiment, the processor 220 mayacquire audio data through the external electronic devices 202 and 204.For example, the processor 220 may receive first audio data from thefirst external electronic device 202 and second audio data from thesecond external electronic device 204 through the communication module290. For example, the first audio data may be audio data correspondingto sound acquired by the first external electronic device 202 through afirst microphone 240. Also, the second audio data may be audio datacorresponding to sound acquired by the second external electronic device204 through a second microphone 250.

Meanwhile, in FIG. 2C, each of the first external electronic device 202and the second external electronic device 204 is shown to include onemicrophone, but this is only for convenience of description, and thenumber of microphones may not be limited thereto. Each of the firstexternal electronic device 202 and the second external electronic device204 may include a plurality of microphones. According to an embodiment,each of the first external electronic device 202 and the second externalelectronic device 204 may selectively transmit audio data receivedthrough a plurality of microphones to the electronic device 101.

According to various embodiments, the processor 220 may establish atleast one communication link with the plurality of external electronicdevices 202 and 204 through the communication module 290 (e.g., thecommunication module 190 of FIG. 1). The processor 220 may transmit asignal indicating the occurrence of an event for acquiring video (orvideo data) by using the camera 280, to at least one of the plurality ofexternal electronic devices 202 and 204 through the at least onecommunication link. For example, the signal indicating the occurrence ofthe event may be transmitted using at least one of various communicationtechnologies supported by the electronic device 201 (or thecommunication module 290). The signal indicating the occurrence of theevent may be replaced with a signal requesting audio data to betransmitted to the electronic device 201, or may be included in a signalrequesting audio data.

For example, an event may mean that a function using a camera, aspecific function within the camera, a function related to the camera,or an application (e.g., an application related to the camera) isexecuted.

According to various embodiments, the processor 220 may obtaininformation on the wearing states of the plurality of externalelectronic devices 202 and 204 through the communication module 290. Forexample, when the wearing state is checked by a sensor included in eachof the plurality of external electronic devices 202 and 204, each of theplurality of external electronic devices 202 and 204 may transmit theinformation on the wearing state to the electronic device 201. Theprocessor 220 may confirm the wearing state of each of the plurality ofexternal electronic devices 202 and 204 based on the information on thewearing state received from each of the plurality of external electronicdevices 202 and 204. In addition, the processor 220 may display theinformation on the wearing state through the display 260 (e.g., thedisplay module 160 of FIG. 1).

According to various embodiments, in a state in which the plurality ofexternal electronic devices 202 and 204 are worn, the processor 220 mayreceive audio data corresponding to sound acquired by each of theplurality of external electronic devices 202 and 204, from each of theplurality of external electronic devices 202 and 204 according to apredetermined order in predetermined time periods through the at leastone communication link. For example, the processor 220 may sequentiallyreceive first audio data corresponding to first sound acquired by thefirst external electronic device 202 and second audio data correspondingto second sound acquired by the second external electronic device 204.For example, the processor may receive the first audio data in apredetermined first time period and may receive the second audio data ina predetermined second time period. For example, the second time periodmay be different from the first time period.

According to various embodiments, the processor 220 may synchronize thefirst audio data and the second audio data with the video acquiredthrough the camera 280 based on time and an order at which each of theplurality of external electronic devices 202 and 204 acquires sound. Forexample, the processor 220 may acquire stereo audio data using the firstaudio data and the second audio data. For example, the electronic device201 may generate stereo audio data by processing each piece of audiodata received with the same time period or with the same sequence numberas if each piece of audio data were audio data at the same time point.For example, the processor 220 may decode the first audio data and thesecond audio data through a separate audio DSP (not shown). Throughthis, the processor 220 may process the first audio data and the secondaudio data, which are mono audio, into stereo audio data. Alternatively,the processor 220 may directly process the first audio data and thesecond audio data into stereo audio data in an application layer.

According to various embodiments, the processor 220 may receive, fromeach of the plurality of external electronic devices 202 and 204, sensorinformation (e.g., information acquired by the sensor included in theplurality of external electronic devices 202 and 204) and/orcommunication quality information (e.g., information indicatingcommunication quality between the plurality of external electronicdevices 202 and 204 and the electronic device 201) as well as audio data(e.g., the first audio data and the second audio data). The processor220 may generate stereo audio data by using the sensor informationand/or the communication quality information, in addition to the firstaudio data and the second audio data.

According to various embodiments, the processor 220 may synchronize thestereo audio data with video. The processor 220 may store the videosynchronized with the audio data in the memory 230.

According to various embodiments, as shown in FIG. 2A, the processor 220may receive the first audio data acquired by the first externalelectronic device 202 through the first communication link establishedwith the first external electronic device 202, and may receive thesecond audio data acquired by the second external electronic device 204through the second communication link established with the secondexternal electronic device 204.

According to various embodiments, as shown in FIG. 2B, the processor 220may receive the first audio data and the second audio data from thefirst external electronic device 202 and the second external electronicdevice 204 through the first communication link established with thefirst external electronic device 202.

According to various embodiments, the processor 220 may receive thefirst audio data and the second audio data from the first externalelectronic device 202 through the first communication link establishedwith the first external electronic device 202. For example, the secondexternal electronic device 204 may transmit the second audio data to thefirst external electronic device 202, and the first external electronicdevice 202 may transmit the first audio data and the second audio datato the electronic device 201 through the first communication link.

According to various embodiments, the processor 220 may receive thefirst audio data and the second audio data using at least one of anextended synchronous connections (eSCO) communication channel, anasynchronous connection-less (ACL) communication channel, or a BLEcommunication channel.

According to various embodiments, the processor 220 may display a firststatus bar corresponding to the first audio data and a second status barcorresponding to the second audio data through the display 260. Forexample, the first status bar may indicate at least one of a receptionstate of the first audio data, a volume of the first audio data, and asound quality of the first audio data. In addition, the second statusbar may indicate at least one of a reception state of the second audiodata, a volume of the second audio data, and a sound quality of thesecond audio data. In addition, the processor 220 may adjustconfiguration for the volume of the second audio data and/or the soundquality of the second audio data according to a user's input to thefirst and second status bars.

Meanwhile, at least some of the operations of the electronic device 201described below may be performed by the processor 220. However, forconvenience of description, the following operations of the electronicdevice 201 will be described as being performed by the electronic device201.

FIG. 3 is a flowchart illustrating a method of operating an electronicdevice, according to various embodiments.

Referring to FIG. 3, according to various embodiments, in operation 301,an electronic device (e.g., the electronic device 201 of FIG. 2) mayestablish a communication link with at least one external electronicdevice (e.g., the external electronic devices 202 and/or 204 of FIG. 2).For example, as shown in FIG. 2A, the electronic device 201 mayestablish a communication link (e.g., link 1 and link 2) for each of theplurality of external electronic devices 202 and 204. Alternatively, asshown in FIG. 2B, the electronic device 201 may share the firstcommunication link (e.g., link 1) established by the first externalelectronic device 202 with the second external electronic device 204.

According to various embodiments, in operation 303, when an event (e.g.,an event for shooting a video) using a camera (e.g., the camera 280 ofFIG. 2C) occurs, the electronic device 201 may transmit a signalindicating the occurrence of the event to the plurality of externalelectronic devices 202 and 204. For example, the event may mean that afunction or application using a camera is executed.

Hereinafter, for convenience of description, the event is described asan event for shooting a video, but the technical idea of the disclosuremay not be limited thereto. For example, the event for shooting a videomay be an event related to the function of using a camera.

According to various embodiments, in operation 303, when an event forshooting a video using a camera (e.g., the camera 280 of FIG. 2C)occurs, the electronic device 201 may perform operation 301 to establisha communication link with at least one external electronic device. Forexample, the electronic device 201 may activate the communication module290 based on the occurrence of the event for shooting a video using thecamera, and may establish a communication link with at least oneexternal electronic device (e.g., the first external electronic device202 and/or the second external electronic device 204) around theelectronic device 201.

According to various embodiments, in operation 305, the electronicdevice 201 may receive audio data acquired by the plurality of externalelectronic devices 202 and 204. For example, the plurality of externalelectronic devices 202 and 204 may acquire audio data corresponding toambient sound in response to a signal indicating the occurrence of anevent. The plurality of external electronic devices 202 and 204 maytransmit the acquired audio data to the electronic device 201 through atleast one communication link.

According to various embodiments, when the plurality of externalelectronic devices 202 and 204 receive the signal indicating theoccurrence of an event for shooting a video from the electronic device201, the wearing states of the plurality of external electronic devices202 and 204 may be checked. For example, when the plurality of externalelectronic devices 202 and 204 are worn on a part of a user's body, amicrophone (e.g., a first microphone 240 and a second microphone 250)may be activated to acquire audio data. Alternatively, when theplurality of external electronic devices 202 and 204 are not worn on thepart of the user's body, a notification (e.g., vibration, sound, or LEDdisplay) may be provided to the user.

According to various embodiments, in a case in which the plurality ofexternal electronic devices 202 and 204 are worn on different users, theplurality of external electronic devices 202 and 204 may process a voicesignal for a voice of a user wearing the corresponding externalelectronic device to be distinguished when acquiring audio data byobtaining ambient sound. Through this, after synchronizing the audiodata with the video data, the electronic device 201 may process toreproduce only the voice of a specific user during video playback.

According to various embodiments, in operation 307, the electronicdevice 201 may synchronize the audio data received from the plurality ofexternal electronic devices 202 and 204 with video and may store thesynchronized data. For example, the electronic device 201 may acquirestereo audio data by using first audio data and second audio data. Also,the electronic device 201 may synchronize the stereo audio data withvideo (or video data) and may output and/or store the synchronizedvideo.

FIG. 4 is a flowchart illustrating a method of shooting a video by anelectronic device using a plurality of external electronic devices,according to various embodiments.

Referring to FIG. 4, according to various embodiments, in operation 401,an electronic device (e.g., the electronic device 201 of FIG. 2) mayestablish a communication link with external electronic devices (e.g.,the external electronic devices 202 and 204 of FIG. 2). The electronicdevice 201 may establish a communication link using a BLE communicationtechnology. For example, the electronic device 201 may receive anadvertisement signal from the first external electronic device 202, andmay establish a first communication link with the first externalelectronic device 202 based on the received advertisement signal.

According to various embodiments, in operation 403, the electronicdevice 201 may determine or confirm whether it is necessary to establishtwo communication links with respect to the two external electronicdevices 202 and 204. For example, the electronic device 201 maydetermine whether it is necessary to generate a topology between theexternal electronic devices 202 and 204 in a true wireless stereo plus(TWS) method or a BLE method, and may determine whether it is necessaryto establish two communication links (e.g., two BT links or BLE links)according to the determination result.

According to various embodiments, when it is not necessary to establishtwo communication links (No in operation 403), in operation 405, theelectronic device 201 may establish a first communication link with thefirst external electronic device 202.

According to various embodiments, when it is necessary to establish twocommunication links (YES in operation 403), in operation 407, theelectronic device 201 may establish a second communication link with thesecond external electronic device 204. Next, the electronic device 201may also establish the first communication link with the first externalelectronic device 202. According to an embodiment, when it is necessaryto establish two communication links, the first communication link withthe first external electronic device 202 may be established in operation405, and then the second communication link with the second externalelectronic device 204 may be established in operation 407. For example,when a true wireless stereo (TWS) plus method is used, the electronicdevice 201 may establish a BT link with each of the first externalelectronic device 202 and the second external electronic device 204.When a BLE method (e.g., AoBLE method) is used, the electronic device201 may establish a BLE link with each of the first external electronicdevice 202 and the second external electronic device 204.

According to various embodiments, when establishing a communication linkor at a specific time after establishing a communication link, theelectronic device 201 may determine a communication method and/or acommunication property to be used for binaural recording based onvarious criteria. For example, when it is determined that real-time isimportant to a binaural recording function, the electronic device 201may determine to use a communication method that prioritizes real-timethrough an eSCO communication channel. When it is determined thatselection of high sound quality is important, the electronic device 201may determine to use a communication method that prioritizes stablesound quality through an ACL communication channel. In addition, theelectronic device 201 may determine to use a communication methodrequiring complex advantages through a BLE communication channel such asAoBLE. The electronic device 201 may determine a communication methodand/or communication property to be used for the binaural recordingfunction, and may then transmit the determined communication methodand/or communication property to the external electronic devices 202 and204, thereby receiving audio data using a predetermined communicationmethod and/or communication property.

According to various embodiments, in operation 409, the electronicdevice 201 may determine the occurrence of an event for shooting avideo. For example, the electronic device 201 may determine whether afunction (or application) for shooting a video or performing a videocall has been executed.

According to various embodiments, when an event for shooting a videooccurs, in operation 411, the electronic device 201 may determinewhether a video shooting or video call function is configured to abinaural mode or a binaural recording mode. For example, the binauralmode (or binaural recording mode) may mean a mode for synchronizingstereo audio data with video during video recording. For example, in thebinaural mode (or binaural recording mode), the electronic device 201may perform video recording using stereo audio data, thereby providing avideo recording function having a feeling as if a user hears soundthrough his/her ears. For example, in the binaural mode (or binauralrecording mode), the electronic device 201 may generate video (or videodata) through a camera and may receive audio data from at least oneexternal electronic device, thereby providing a function of using stereoaudio data for video recording.

According to various embodiments, when the video shooting function isconfigured to the binaural mode (YES in operation 411), in operation413, the electronic device 201 may acquire stereo audio data. Forexample, the electronic device 201 may receive first audio data andsecond audio data from the plurality of external electronic devices 202and 204, and may acquire stereo audio data using the first audio dataand the second audio data. For example, the electronic device 201 maygenerate stereo audio data by processing each piece of audio datareceived with the same time period or with the same sequence number asif each piece of audio data were audio data at the same time point.

According to various embodiments, when the video shooting function isnot configured to the binaural mode (NO in operation 411), in operation415, the electronic device 201 may acquire mono audio data. Theelectronic device 201 may receive first audio data or second audio datafrom any one of the plurality of external electronic devices 202 and 204and may acquire mono audio data using the first audio data or the secondaudio data. According to various embodiments, when the video shootingfunction is not configured to the binaural mode (NO in operation 411),in operation 415, the electronic device 201 may acquire mono audio datathrough a microphone of the electronic device 201.

According to various embodiments, in operation 417, the electronicdevice 201 may synchronize the acquired audio data (e.g., stereo audiodata or mono audio data) with the video. Also, the electronic device 201may store the synchronized video in a memory (e.g., the memory 230 ofFIG. 2) or may output the synchronized video through a display (e.g.,the display 260 of FIG. 2).

According to various embodiments, when receiving audio data from atleast one external electronic device, the electronic device 201 mayoutput information related to the reception of the audio data throughthe display (e.g., the display 260 of FIG. 2). For example, whether themicrophone of the electronic device 201 is used and/or whether audiodata is normally received from at least one external electronic devicemay be displayed.

FIG. 5 is a flowchart illustrating a method of transmitting audio datato an electronic device by a first external electronic device, accordingto various embodiments.

Referring to FIG. 5, according to various embodiments, in operation 501,a first external electronic device (e.g., the first external electronicdevice 202 of FIG. 2) may establish a first communication link with anelectronic device (e.g., the electronic device 201 of FIG. 2).

According to various embodiments, in operation 503, the first externalelectronic device 202 may determine whether a sniffing function isrequired. However, when the first external electronic device 202 onlyuses a sniffing topology, the first external electronic device 202 maynot determine whether the sniffing function is required. In this case,operation 503 may be omitted.

According to various embodiments, when the sniffing function isrequired, in operation 505, the first external electronic device 202 mayestablish a third communication link with the second external electronicdevice 204. In operation 507, the first external electronic device 202may share information on the first communication link with the secondexternal electronic device 204 through the third communication link. Forexample, the information on the first communication link may include atleast one information of a Bluetooth address of the electronic device201, FHS packet information (LT address or piconet clock), a link key, aused channel map, SDP result information, a supported feature, or EIRdata. According to an embodiment, the first external electronic device202 may determine whether the sniffing function is required based onwhether the second external electronic device 204 operating in a pairwith the first external electronic device 202 and/or establishing acommunication link with the first external electronic device 202 isexisted. For example, according to the determination result, beforeestablishing the first communication link with the electronic device 201in operation 501, the first external electronic device 202 may establisha third communication link with the second external electronic device204.

According to various embodiments, when the sniffing function is notrequired, in operation 509, the first external electronic device 202 maydetermine whether an event for shooting a video occurs. For example,when receiving a signal indicating the occurrence of an event forshooting a video from the electronic device 201, the first externalelectronic device 202 may determine that the event for shooting a videohas occurred. For example, the signal indicating the occurrence of theevent for shooting a video may include information for requesting audiodata from the first external electronic device 202.

According to various embodiments, when it is determined that the eventfor shooting a video has occurred, in operation 511, the first externalelectronic device 202 may determine a wearing state of the firstexternal electronic device 202 using a sensor. For example, the firstexternal electronic device 202 may determine whether the first externalelectronic device 202 is worn on the user's ear using a pressure sensor,a biometric sensor, and/or a proximity sensor.

Meanwhile, the order of operations 509 and 511 may not be limitedthereto. For example, operation 511 may be performed first, andoperation 509 may be performed later.

According to various embodiments, when it is determined that the firstexternal electronic device 202 is worn on the user, in operation 513,the first external electronic device 202 may acquire first audio datacorresponding to ambient sound using a first microphone (e.g., the firstmicrophone 240 of FIG. 2). Also, in operation 513, the first externalelectronic device 202 may transmit the first audio data to theelectronic device 201. According to an embodiment, a time period fortransmitting and receiving data may be configured between the firstexternal electronic device 202 and the electronic device 201 and/or thesecond external electronic device 204. The first external electronicdevice 202 may transmit data to the electronic device 201 in adesignated time period.

According to various embodiments, the first external electronic device202 may further include an additional microphone in addition to thefirst microphone. In this case, the first external electronic device 202may acquire audio corresponding to ambient sound using the additionalmicrophone, and may output the acquired audio through a speaker includedin the first external electronic device 202. Through this, the user maycheck the audio acquired through the first external electronic device202 in real time.

FIG. 6 is a flowchart illustrating a method of shooting a video by anelectronic device using a plurality of external electronic devices,according to various embodiments.

Referring to FIG. 6, according to various embodiments, in operation 601,an electronic device (e.g., the electronic device 201 of FIG. 2) mayperform an event for shooting a video in a binaural mode (or binauralrecording mode).

According to various embodiments, in operation 603, the electronicdevice 201 may receive first audio data from a first external electronicdevice 202 in a predetermined first time period. The first time periodmay be determined in an operation of establishing a communication linkby the electronic device 201 and the first external electronic device202.

According to various embodiments, in operation 605, the electronicdevice 201 may receive second audio data from the second externalelectronic device 204 in a predetermined second time period. Forexample, the second time period may be determined in an operation ofestablishing a communication link by the electronic device 201 and thesecond external electronic device 204. For example, the second timeperiod may be a time period different from the first time period. Forexample, the first time period and the second time period may have thesame length of time when using an eSCO communication method. On theother hand, the first time period and the second time period may havedifferent lengths of time when using an ACL communication method.According to various embodiments, when the first external electronicdevice 202 and/or the second external electronic device 204 use thesniffing function, the second time period may be determined in anoperation of establishing a communication link by the electronic device201 and the first external electronic device 202. According to variousembodiments, when the first external electronic device 202 and/or thesecond external electronic device 204 use the sniffing function, theelectronic device 201 may not know the existence of the second externalelectronic device 204 (e.g., a device sniffing the first link).According to various embodiments, when the first external electronicdevice 202 and the second external electronic device 204 use thesniffing function, the first external electronic device 202 may notifythe electronic device 201 of the existence of the device sniffing thefirst link (e.g., the second external electronic device 204).

According to various embodiments, in operation 607, the electronicdevice 201 may acquire stereo audio data by using first audio data andsecond audio data.

According to various embodiments, in operation 609, the electronicdevice 201 may synchronize stereo audio data with video. For example,the electronic device 201 may synchronize stereo audio data with videoin consideration of a latency between the stereo audio data and videodata. According to various embodiments, the electronic device 201 maysynchronize the stereo audio data with the video based on a transmissiondelay time required to receive first audio data from the first externalelectronic device 202 and a difference between time required to processfirst audio data after receiving first audio data and time required forthe electronic device 201 to generate video data.

Meanwhile, in a method of operating the electronic device described inthe specification, it is described that the electronic device 201receives the first audio data before the second audio data, but this isonly an example, and the technical idea of the disclosure may not belimited thereto. For example, the electronic device 201 may receiveaudio data according to a predetermined order, and may receive thesecond audio data before the first audio data.

FIG. 7 is a diagram illustrating a method of receiving audio data from aplurality of external electronic devices by an electronic device,according to various embodiments.

Referring to FIG. 7, according to various embodiments, in operation 701,the electronic device 201 may establish at least one communication linkwith the first external electronic device 202 and the second externalelectronic device 204. For example, the electronic device 201 mayestablish at least one communication link with the first externalelectronic device 202 and the second external electronic device 204 bythe method described with reference to FIGS. 2A and 2B.

According to various embodiments, in operation 703, the electronicdevice 201 may start an operation of shooting a video based on abinaural mode (or a binaural recording mode). For example, theelectronic device 201 may start a video shooting or video call function(or application) in response to a user input, and whether to performvideo shooting based on the binaural mode may be configured in advanceor determined according to the user input. For example, the electronicdevice 201 may provide a notification recommending that a user shoot avideo in the binaural mode in a specific place (e.g., a concert hall, abeach, or an amusement park). Alternatively, the electronic device 201may be configured to shoot a video in the binaural mode in the specificplace (e.g., a concert hall, a beach, or an amusement park) according toa user input.

According to various embodiments, in operation 705, the electronicdevice 201 may transmit a signal indicating the occurrence of an eventto the first external electronic device 202 through a firstcommunication link established by the first external electronic device202. In operation 706, the electronic device 201 may transmit the signalindicating the occurrence of an event to the second external electronicdevice 204 through the first communication link. Alternatively, theelectronic device 201 may transmit the signal indicating the occurrenceof an event to the second external electronic device 204 through asecond communication link established by the second external electronicdevice 204. According to various embodiments, when the second externalelectronic device 204 is operated in a sniffing mode, the secondexternal electronic device 204 may receive a signal transmitted to thefirst external electronic device 202 by the electronic device 201through the first communication link. In this case, operation 706 may beomitted.

According to various embodiments, in operation 707, the electronicdevice 201 may receive first audio data transmitted by the firstexternal electronic device 202, in a predetermined first time period. Inoperation 708, the electronic device 201 may transmit, in thepredetermined first time period, an acknowledgement (ACK) signal to thefirst external electronic device 202 when the first audio data isreceived. Alternatively, when the first audio data is not received, theelectronic device 201 may transmit a negative acknowledgement (NACK)signal to the first external electronic device 202.

According to various embodiments, in operation 709, the electronicdevice 201 may receive second audio data transmitted by the secondexternal electronic device 204 in a second predetermined time period. Inoperation 710, the electronic device 201 may transmit, in the secondpredetermined time period, an ACK signal to the second externalelectronic device 204 when the second audio data is received.Alternatively, when the second audio data is not received, theelectronic device 201 may transmit an NACK signal to the second externalelectronic device 204.

According to various embodiments, when the second external electronicdevice 204 operates in a sniffing mode, the electronic device 201 andthe first external electronic device 202 may be configured to allow thefirst external electronic device 202 to transmit additional informationin the second time period or allow the second external electronic device204 to transmit the second audio data to the electronic device 201through the first communication link.

According to various embodiments, the electronic device 201 mayrepeatedly perform operations 707 to 710 until the operation of shootinga video is terminated.

According to various embodiments of the disclosure, the following FIGS.8A, 8B, 9A, and 9B may relate to a method of receiving audio data from aplurality of external electronic devices by an electronic device basedon a sniffing method. However, these embodiments in which an electronicdevice of the disclosure receives audio data from a plurality ofexternal electronic devices, and the technical idea of the disclosureare not be limiting.

FIG. 8A is a diagram illustrating a method of receiving audio data froma plurality of external electronic devices by an electronic device,according to various embodiments, and FIG. 8B is a diagram illustratingmethod of receiving audio data from a plurality of external electronicdevices by an electronic device, according to various embodiments.

Referring to FIG. 8A, according to various embodiments, the electronicdevice 201 may receive first audio data AU1-1 and second audio dataAU1-2 through an eSCO communication link.

According to various embodiments, the electronic device 201 may receivethe first audio data AU1-1 from the first external electronic device 202in a first time period (e.g., T1). When the first audio data AU1-1 isreceived, the electronic device 201 may transmit a first ACK signalACK1-1 to the first external electronic device 202 in the first timeperiod (e.g., T1). For example, the first time period T1 may be a TeSCOtime period. Alternatively, the first time period T1 may be a timeperiod indicating the start of TeSCO. For example, the first audio dataAU1-1 may be data encoded by the first external electronic device 202 orraw data without separate encoding performed thereon, after first soundis introduced into a first microphone 240 of the first externalelectronic device 202.

According to various embodiments, the electronic device 201 may receivesecond audio data AU1-2 from the second external electronic device 204in a second time period T2. When the second audio data AU1-2 isreceived, the electronic device 201 may transmit a second ACK signalACK1-2 to the second external electronic device 204. For example, thesecond time period T2 may be a WeSCO time period. Alternatively, thesecond time interval T1 may be a time period indicating the start ofWeSCO. For example, the second audio data AU1-2 may be data encoded bythe second external electronic device 204 or raw data without separateencoding performed thereon, after second sound is introduced into asecond microphone 250 of the second external electronic device 204.

According to various embodiments, after receiving the first audio dataAU1-1 and the second audio data AU1-2, the electronic device 201 mayreceive the next first audio data AU2-1 and second audio data AU2-2.

According to various embodiments, the electronic device 201 may receivethe first audio data AU2-1 from the first external electronic device 202in a first time period (e.g., T3). The electronic device 201 maytransmit a first ACK signal ACK2-1 or a first NACK signal NACK2-1 to thefirst external electronic device 202 in the first time period (e.g., T3)according to whether the first audio data AU2-1 is received. Forexample, when the first audio data AU2-1 is received, the electronicdevice 201 may transmit the first ACK signal ACK2-1 to the firstexternal electronic device 202 in the first time period (e.g., T3).Alternatively, when the first audio data AU2-1 is not normally received,the electronic device 201 may transmit the first NACK signal NACK2-1 tothe first external electronic device 202 in the first time period (e.g.,T3). When the first NACK signal NACK2-1 is received, the first externalelectronic device 202 may retransmit the first audio data AU2-1 to theelectronic device 201 in the next first time period (e.g., a first timeperiod after a second time period (e.g., T4)). When the first audio dataAU2-1 is received, the electronic device 201 may transmit the first ACKsignal ACK2-1 to the first external electronic device 202 in the nextfirst time period.

According to various embodiments, the electronic device 201 may receivesecond audio data AU2-2 from the second external electronic device 204in a second time period (e.g., T4). The electronic device 201 maytransmit a second ACK signal ACK2-2 or a second NACK signal NACK2-2 tothe second external electronic device 204 in the second time period(e.g., T4) according to whether the second audio data AU2-2 is received.For example, when the second audio data AU2-2 is received, theelectronic device 201 may transmit the second ACK signal ACK2-2 to thesecond external electronic device 204 in the second time period (e.g.,T4). Alternatively, when the second audio data AU2-2 is not normallyreceived, the electronic device 201 may transmit the second NACK signalNACK2-2 to the second external electronic device 204 in the second timeperiod (e.g., T4). When the second NACK signal NACK2-2 is received, thesecond external electronic device 204 may retransmit the second audiodata AU2-2 to the electronic device 201. When the second NACK signalNACK2-2 is received, the second external electronic device 204 mayretransmit the second audio data AU2-2 to the electronic device 201 inthe next second time period (e.g., a second time period after the nextfirst time period). When the second audio data AU2-2 is received, theelectronic device 201 may transmit the second ACK signal ACK2-2 to thesecond external electronic device 204 in the next second time period.

According to various embodiments, the electronic device 201 maysequentially receive the first audio data AU2-1 and second audio dataAU2-2. According to various embodiments, the electronic device 201 maytransmit the first audio data (e.g., AU1-1 or AU1-2) received from thefirst external electronic device 202 and the second audio data (e.g.,AU2-1 or AU2-2) received from the second external electronic device 204through a codec. For example, the electronic device 201 may transmit thefirst audio data (e.g., AU1-1) and the second audio data (e.g., AU2-1)before receiving the next first audio data (e.g., AU1-2) and secondaudio data (e.g., AU2-2) or at the same time as when the next firstaudio data (e.g., AU1-2) and second audio data (e.g., AU2-2) aresubstantially received.

According to various embodiments, the electronic device 201 mayrepeatedly perform the above-described operation until the operation ofshooting a video is terminated.

Referring to FIG. 8B, according to various embodiments, the electronicdevice 201 may receive first audio data and second audio data through aneSCO communication link. However, the electronic device 201 of FIG. 8Bmay receive the first audio data and the second audio data withouttransmitting an ACK signal to the external electronic devices 202 and204, as compared with FIG. 8A. For example, in a time period forreceiving the ACK signal (e.g., ACK1-1 or ACK1-2) of FIG. 8A from theelectronic device 201, the first external electronic device 202 and thesecond external electronic device 204 may additionally transmit thefirst audio data (e.g., AU1-1 or AU1-2) and the second audio data (e.g.,AU2-1 or AU2-2).

According to various embodiments, when the electronic device 201 usesthe eSCO communication method as shown in FIGS. 8A and 8B, each of thetime periods for acquiring the first audio data and the second audiodata may have the same length of time.

FIG. 9A is a diagram illustrating a method of receiving audio data froma plurality of external electronic devices by an electronic device,according to various embodiments, and FIG. 9B is a diagram illustratinga method of receiving audio data from a plurality of external electronicdevices by an electronic device, according to various embodiments.

Referring to FIG. 9A, according to various embodiments, the electronicdevice 201 may receive first audio data and second audio data through anACL communication link.

According to various embodiments, the electronic device 201 may receivefirst audio data AU1-1 from the first external electronic device 202 ina first time period T1. When the first audio data AU1-1 is received, theelectronic device 201 may transmit a first ACK signal ACK1-1 to thefirst external electronic device 202. The electronic device 201 mayreceive second audio data AU1-2 from the second external electronicdevice 204 in a second time period T2. When the second audio data AU1-2is received, the electronic device 201 may transmit a second ACK signalACK1-2 to the second external electronic device 204. For example, thefirst external electronic device 202 and the second external electronicdevice 204 may transmit the first audio data AU1-1 and the second audiodata AU1-2, respectively, in a predetermined order or in predeterminedfirst time period T1 and second time period T2.

According to various embodiments, after sequentially receiving the firstaudio data AU1-1 and the second audio data AU1-2, the electronic device201 may transmit the received first audio data AU2-1 and second audiodata AU2-2 through a codec.

According to various embodiments, the electronic device 201 may receivethe next first audio data AU2-1 and second audio data AU2-2. Forexample, the electronic device 201 may receive the first audio dataAU2-1 from the first external electronic device 202 in the first timeperiod. When the first audio data AU2-1 is received, the electronicdevice 201 may transmit a first ACK signal ACK2-1 to the first externalelectronic device 202.

According to various embodiments, the electronic device 201 may receivethe second audio data AU2-2 from the second external electronic device204 in the second time period. When the second audio data AU2-2 is notreceived within the second time period, the electronic device 201 maytransmit a second NACK signal NACK2-2 to the second external electronicdevice 204. When the second audio data AU2-2 is received within thesecond time period, the electronic device 201 may transmit a second ACKsignal ACK2-2 to the second external electronic device 204.

According to various embodiments, when failing to receive the second ACKsignal ACK2-2 from the electronic device 201 while retransmitting thesecond audio data AU2-2 for a designated number of times or for adesignated time, the second external electronic device 204 may transmitsecond audio data AU3-2 corresponding to the next turn to the electronicdevice 201. In this case, the second external electronic device 204 maytransmit the second audio data AU3-2 to the electronic device 201 in asecond time period corresponding to the next turn.

According to various embodiments, the first external electronic device202 may transmit the first audio data AU1-1 or AU2-1, and may retransmitthe first audio data AU1-1 or AU2-1 after the second time period (T2 orT4) when failing to receive the first ACK signal (ACK1-1 or ACK2-1) fromthe electronic device 201. According to various embodiments, whenfailing to receive an ACK signal (e.g., the first ACK signal and thesecond ACK signal) from the electronic device 201, each of the firstexternal electronic device 202 and the second external electronic device204 may retransmit the audio data (e.g., the first audio data or thesecond audio data) in a designated order and/or at a designated timeafter the second time period (T2 or T4).

According to various embodiments, when failing to receive the firstaudio data and/or the second audio data, the electronic device 201 maygenerate stereo audio data using the audio data received through amicrophone included in the electronic device 201, and may synchronizethe generated stereo audio data with a video acquired through a camera(e.g., the camera 280 of FIG. 2).

According to various embodiments, after sequentially receiving the firstaudio data AU2-1 and the second audio data AU2-2, the electronic device201 may transmit the first audio data AU2-1 and the second audio dataAU2-2 through a codec.

Referring to FIG. 9B, according to various embodiments, the electronicdevice 201 may receive the first audio data and the second audio datathrough an ACL communication link. However, as compared to FIG. 9A, theelectronic device 201 of FIG. 9B may receive first audio data and secondaudio data without transmitting an ACK signal to external electronicdevices 202 and 204. For example, in a time period for receiving the ACKsignal (e.g., ACK1-1 or ACK1-2) of FIG. 9A from the electronic device201, the first external electronic device 202 and the second externalelectronic device 204 may additionally transmit the first audio data(e.g., AU1-1 or AU1-2) and second audio data (AU2-1 or AU2-2). Accordingto various embodiments, the first external electronic device 202 and thesecond external electronic device 204 may transmit audio data (e.g., thefirst audio data and/or the second audio data) to the electronic device201 a designated number of times in a designated order and a designatedtime period.

According to various embodiments, when using the ACL communicationmethod as shown in FIGS. 9A and 9B described above, each of the timeperiods for acquiring the first audio data and the second audio data mayhave a different time length.

According to various embodiments, the electronic device 201 mayrepeatedly perform the above-described operation until the operation ofshooting a video is terminated.

The number of time slots illustrated in FIGS. 8A, 8B, 9A, and 9B is forconvenience of description, and the technical idea of the disclosure maynot be limited thereto. For example, when the first communication linkbetween the electronic device 201 and the first external electronicdevice 202 is a communication link using the eSCO method, the firstcommunication link may be configured to include a transmission/receptionperiod (TeSCO) of 16 slots and a retransmission period (WeSCO) of 4slots.

FIG. 10 is a diagram illustrating a method of receiving audio data froma plurality of external electronic devices by an electronic deviceaccording to various embodiments.

Referring to FIG. 10, according to various embodiments, the electronicdevice 201 may receive first audio data and second audio data through aBLE communication link. For example, the electronic device 201 mayreceive the first audio data and the second audio data through an AoBLEcommunication link among various BLE communication links.

According to various embodiments, the electronic device 201 may allocatean event time for the first external electronic device 202 and thesecond external electronic device 204 and sub-event periods within thecorresponding event time. Next, the electronic device 201 may receivethe first audio data and the second audio data from each of thesub-event sections. For example, in a case in which the electronicdevice 201 uses the AoBLE communication link, all time periods (e.g., anevent time period and sub-event time periods within a correspondingevent time period) may be determined when the electronic device 201establishes a communication link with the first external electronicdevice 202 and/or the second external electronic device 204. Inaddition, at least some of the time periods (e.g., the event time periodand the sub-event time periods within the corresponding time period) maybe appropriately adjusted to a resource through a specific message asneeded after the communication link is established. According to variousembodiments, when the electronic device 201 receives the first audiodata from the first external electronic device 202 and the second audiodata from the second external electronic device 204 through one linksuch as in a sniffing method, a first sub-event period 1010 and a secondsub-event period 1020 may be time periods allocated to the same link.According to various embodiments, when the electronic device 201receives the first audio data from the first external electronic device202 and the second audio data from the second external electronic device204 through a plurality of links, the first sub-event period 1010 and asecond sub-event period 1020 may be time periods allocated to differentlinks.

According to various embodiments, the electronic device 201 may allocate“event time X” and the first sub-event period 1010 and the secondsub-event period 1020 included in “event time X”. The electronic device201 may receive the first audio data from the first external electronicdevice 202 in the first sub-event period 1010, and may receive thesecond audio data from the second external electronic device 204 in thesecond sub-event period 1020.

According to various embodiments, the electronic device 201 mayrepeatedly perform the above-described operation until the operation ofshooting a video is terminated.

FIG. 11 is a diagram illustrating a method of synchronizing video andaudio data by an electronic device, according to various embodiments.

Referring to FIG. 11, according to various embodiments, an electronicdevice (e.g., the electronic device 201 of FIG. 2) may synchronizestereo audio data (e.g., A1 to A4) with video data (e.g., first videoand second video) acquired through a camera (e.g., the camera 280 ofFIG. 2). For example, the electronic device 201 may synchronize stereoaudio data with video data by compensating for a latency L1 betweenaudio data (e.g., first audio data A1) and video data (e.g., firstvideo). For example, the electronic device 201 may synchronize stereoaudio data with the video data by delaying the video data by timecorresponding to the latency L1.

According to various embodiments, the electronic device 201 may confirma transmission delay time required for first sound input to a firstmicrophone 240 of the first external electronic device 202 to bereceived by the electronic device 201 as first audio data (audio datacorresponding to the first sound). For example, the electronic device201 may confirm the transmission delay time based on time informationwhen the first external electronic device 202 generates the first audiodata, time information when the first external electronic device 202transmits the first audio data, and/or time information when theelectronic device 201 receives the first audio data. In addition, afterreceiving the first audio data, the electronic device 201 may confirmtime required to process the first audio data for each layer of theelectronic device 201. The electronic device 201 may acquire a latencyL1 between the audio data and the video data based on the transmissiondelay time required to receive the first audio data from the firstexternal electronic device 202 and the time required to process thefirst audio data.

According to various embodiment, the electronic device 201 maysynchronize the audio data with the video data by compensating for thelatency L1 between the audio data and the video data. Also, theelectronic device 201 may store the synchronized data in a memory (e.g.,the memory 230 of FIG. 2) or may output the synchronized data through adisplay (e.g., the display 260 of FIG. 2).

According to various embodiments, a latency between the first video dataand the audio data (e.g., A1 and/or A2) and a latency between the secondvideo data and the audio data (e.g., A3 and/or A4) may be the same ordifferent. For example, when the latency between the first video dataand the first audio data A1 and the latency between the second videodata and the third audio data A3 are the same, the latency between thefirst video data and the first audio data A1 may be applied to the videodata (e.g., the first video data and the second video data). For anotherexample, when the latency between the first video data and the firstaudio data A1 and the latency between the second video data and thethird audio data A3 are different, a latency between the second videodata and third audio data A3 may be confirmed and applied to the secondvideo data.

FIGS. 12A, 12B, 12C, 12D, and 12E are user interfaces illustrating amethod of shooting a video by an electronic device using a plurality ofexternal electronic devices according to various embodiments.

Referring to FIG. 12A, according to various embodiments, an electronicdevice 1201 (e.g., the electronic device 201 of FIG. 2) may display apreview screen 1210 when a video shooting function (or video recording)is performed.

According to various embodiments, the electronic device 1201 may displaya recording start object 1211 on the preview screen 1210. Also, theelectronic device 1201 may display a first shooting object 1221 and asecond shooting object 1222 on the preview screen 1210. For example,when a user input for the recording start object 1211 is confirmed, theelectronic device 1201 may start a general recording operation.

Referring to FIG. 12B, when a user input for the second shooting object1222 is confirmed, the electronic device 1201 may display a binauralrecording object 1212. For example, when a user input for the binauralrecording object 1212 is confirmed, the electronic device 1201 mayperform a binaural recording operation. After the binaural recordingobject 1212 is displayed, the electronic device 1201 may check thewearing states of the external electronic devices (e.g., the externalelectronic devices 202 and 204 of FIG. 2).

Referring to FIG. 12C, the electronic device 1201 may display objects1231 and 1232 indicating the wearing states of the external electronicdevices (e.g., the external electronic devices 202 and 204 of FIG. 2).For example, when the external electronic devices are a right earphoneand a left earphone, the electronic device 1201 may display the firstobject 1231 indicating the wearing state of the left earphone and thesecond object 1232 indicating the wearing state of the right earphone.For example, the electronic device 1201 may display the first object1231 when the left earphone is normally worn, and may display the secondobject 1232 when the right earphone is normally worn. Alternatively, theelectronic device 1201 may display the first object 1231 and the secondobject 1232 having different colors depending on whether they are worn.For example, the electronic device 1201 may display the first object1231 in blue when the left earphone is worn, and may display the secondobject 1232 in red when the right earphone is not worn.

According to various embodiments, in a state in which at least some ofthe objects 1231 and 1232 indicating the wearing states of the externalelectronic devices 202 and 204 are displayed, the electronic device 1201may start the binaural recording object 1212 when the user input for thebinaural recording object 1212 is confirmed. According to variousembodiments, the electronic device 1201 may start the binaural recordingoperation only when both the right earphone and the left earphone arenormally worn. For example, when at least one of the right earphone andthe left earphone is not normally worn, the electronic device 1201 maydisplay the binaural recording object 1212 in an inactive state.Alternatively, when the at least one of the right earphone and the leftearphone is not normally worn, the electronic device 1201 may notdisplay the binaural recording object 1212 even if the user input forthe second shooting object 1222 is confirmed. In addition, when the atleast one of the right earphone and the left earphone is not normallyworn, the electronic device 1201 may display a message recommendingwearing the earphone.

According to various embodiments, when the video shooting (or videorecording) function is performed, the electronic device 1201 may checkthe wearing states of external electronic devices (e.g., the externalelectronic devices 202 and 204 of FIG. 2), and may display the binauralrecording object 1212 on the preview screen 1210 based on the checkedwearing states of the external electronic devices. For example, theelectronic device 1201 may display the binaural recording object 1212 inan inactive state or may not display the binaural recording object 1212in a state in which the external electronic devices are not normallyworn.

Referring to FIG. 12D, according to various embodiments, when thebinaural recording operation starts, the electronic device 1201 maydisplay a first status bar 1241 indicating the state of the first audiodata and a second status bar 1242 indicating the state of the secondaudio data. For example, the first status bar 1241 may indicate at leastone of a reception state, a volume, and sound quality of audio datareceived from the left earphone. Also, the second status bar 1242 mayindicate at least one of a reception state, a volume, and sound qualityof audio data received from the right earphone. For example, theelectronic device 1201 may display the first status bar 1241corresponding to the left earphone on the left area of the display(e.g., the display 260 of FIG. 2), and may display the second status bar1242 corresponding to the right earphone on right area of the display260.

Referring to FIG. 12E, according to various embodiments, the electronicdevice 1201 may display a first status bar 1251 and a second status bar1252 on the upper right area of the display (e.g., the display 260 ofFIG. 2). For example, the first status bar 1251 and the second statusbar 1252 may have a size smaller than the first status bar 1241 and thesecond status bar 1242 of FIG. 12C.

The electronic device 201 according to various embodiments may include acamera 280; a display 260; a communication module 290 supportingBluetooth communication; and a processor 220. The processor may beconfigured to establish at least one communication link with a pluralityof external electronic devices 202 and 204 through the communicationmodule; transmit a first signal indicating an occurrence of an eventusing the camera to at least one of the plurality of external electronicdevices through the at least one communication link; receive audio datacorresponding to sound acquired by each of the plurality of externalelectronic devices, from each of the plurality of external electronicdevices in predetermined time periods through the at least onecommunication link in a state in which the plurality of externalelectronic devices are worn; and synchronize the audio data with videoacquired using the camera and store the synchronized data, based on timeand an order at which each of the plurality of external electronicdevices acquires the sound.

The processor may be configured to sequentially receive first audio datacorresponding to first sound acquired by the first external electronicdevice 202 among the plurality of external electronic devices and secondaudio data corresponding to second sound acquired by the second externalelectronic device 204 among the plurality of external electronicdevices; and acquire stereo audio data using the first audio data andthe second audio data.

The processor may be configured to receive the first audio data in apredetermined first time period and receive the second audio data in apredetermined second time period.

The processor may be configured to transmit a first ACK signal to thefirst external electronic device in the first time period when the firstaudio data is received and transmit a second ACK signal to the secondexternal electronic device in the second time period when the secondaudio data is received.

The first external electronic device may include an earphone in a firstdirection, and the second external electronic device may include anearphone in a second direction.

The processor may be configured to check a wearing state of each of thefirst external electronic device and the second external electronicdevice; and display information on the wearing state through thedisplay.

The processor may be configured to receive the first audio data througha first communication link established with the first externalelectronic device; and receive the second audio data through a secondcommunication link established with the second external electronicdevice.

The processor may be configured to receive the first audio data from thefirst external electronic device through a first communication linkestablished with the first external electronic device; and receive thesecond audio data from the second external electronic device using thefirst communication link.

The processor may be configured to confirm a latency required foracquiring the audio data; and synchronize the audio data with the videobased on the latency.

The processor may be configured to receive the audio data from each ofthe plurality of external electronic devices using at least one of anextended synchronous connections (eSCO) communication channel, anasynchronous connection-less (ACL) communication channel, and a BLEcommunication channel.

A method of operating the electronic device 201 according to variousembodiments may include establishing at least one communication linkwith the plurality of external electronic devices 202 and 204;transmitting a first signal indicating an occurrence of an event usingthe camera 280 included in the electronic device to at least one of theplurality of external electronic devices through the at least onecommunication link; receiving audio data corresponding to sound acquiredby each of the plurality of external electronic devices, from each ofthe plurality of external electronic devices in predetermined timeperiods through the at least one communication link in a state in whichthe plurality of external electronic devices are worn; and synchronizingthe audio data with video acquired using the camera and storing thesynchronized data, based on time and an order at which each of theplurality of external electronic devices acquires the sound.

The receiving of the audio data may include receiving first audio datacorresponding to first sound acquired by the first external electronicdevice 202 among the plurality of external electronic devices and secondaudio data corresponding to second sound acquired by the second externalelectronic device 204 among the plurality of external electronicdevices; and acquiring stereo audio data using the first audio data andthe second audio data.

The receiving of the audio data may include sequentially receiving thefirst audio data in a predetermined first time period and receiving thesecond audio data in a predetermined second time period.

The method of operating the electronic device may further includetransmitting a first ACK signal to the first external electronic devicein the first time period when the first audio data is received; andtransmitting a second ACK signal to the second external electronicdevice in the second time period when the second audio data is received.

The method of operating the electronic device may further includechecking a wearing state of each of the first external electronic deviceand the second external electronic device; and displaying information onthe wearing state through the display.

The receiving of the audio data may further include receiving the firstaudio data through a first communication link established with the firstexternal electronic device; and receiving the second audio data througha second communication link established with the second externalelectronic device.

The receiving of the audio data may further include receiving the firstaudio data from the first external electronic device through a firstcommunication link established with the first external electronicdevice; and receiving the second audio data from the second externalelectronic device using the first communication link.

The method of operating the electronic device may further includedisplaying a first status bar corresponding to the first audio data anda second status bar corresponding to the second audio data on thedisplay of the electronic device.

The electronic device 202 or 204 according to various embodiments mayinclude a sensor; at least one microphone; a communication modulesupporting Bluetooth communication; and a processor. The processor maybe configured to establish a communication link with external electronicdevices through the communication module; receive a first signalindicating an occurrence of an event of acquiring video using a cameraof the external electronic device from the external electronic devicethrough the communication link; acquiring audio data corresponding toambient sound through the at least one microphone in a state in whichthe electronic device is worn; and transmit the audio data to theexternal electronic device in a predetermined time period through thecommunication module.

The processor may be configured to check a wearing state of theelectronic device through the sensor; and transmit information on thewearing state to the external electronic device through thecommunication module.

Each of the elements of the electronic device may be configured by oneor more components and a name of the corresponding element may varydepending on a type of the electronic device. In various embodiments,the electronic device may be configured to include at least one of theabove-described elements. Some of the above-described elements may beomitted from the electronic device, or the electronic device may furtherinclude additional elements. In addition, some of the elements of theelectronic device according to the various embodiments may be combinedto form a single entity and thus may perform the same functions of thecorresponding elements prior to the combination.

The embodiments disclosed herein are merely provided to easily describethe disclosure and to facilitate understanding of the disclosure but arenot intended to limit the scope of the disclosure. Therefore, it shouldbe construed that all modifications and changes based on the technicalidea of the disclosure or various other embodiments fall within thescope of the disclosure.

Although the present disclosure has been described with variousembodiments, various changes and modifications may be suggested to oneskilled in the art. It is intended that the present disclosure encompasssuch changes and modifications as fall within the scope of the appendedclaims.

1. An electronic device comprising: a camera; a display; a communicationmodule configured to support Bluetooth communication; and a processor,wherein the processor is configured to: establish at least onecommunication link with a plurality of external electronic devicesthrough the communication module; transmit a first signal indicating anoccurrence of an event using the camera to at least one of the pluralityof external electronic devices through the at least one communicationlink; receive audio data corresponding to sound acquired by each of theplurality of external electronic devices, from each of the plurality ofexternal electronic devices in predetermined time periods through the atleast one communication link in a state in which the plurality ofexternal electronic devices are worn; and synchronize the audio datawith video data acquired using the camera and store the synchronizedaudio data, based on time and an order at which each of the plurality ofexternal electronic devices acquires the sound.
 2. The electronic deviceof claim 1, wherein the processor is configured to: sequentially receivefirst audio data corresponding to first sound acquired by a firstexternal electronic device among the plurality of external electronicdevices and second audio data corresponding to second sound acquired bya second external electronic device among the plurality of externalelectronic devices; and acquire stereo audio data using the first audiodata and the second audio data.
 3. The electronic device of claim 2,wherein the processor is configured to: receive the first audio data ina predetermined first time period, and receive the second audio data ina predetermined second time period.
 4. The electronic device of claim 3,wherein the processor is configured to: transmit a firstacknowledgement(ACK) signal to the first external electronic device inthe predetermined first time period when the first audio data isreceived; and transmit a second ACK signal to the second externalelectronic device in the predetermined second time period when thesecond audio data is received.
 5. The electronic device of claim 2,wherein: the first external electronic device includes an earphone in afirst direction, and the second external electronic device includes anearphone in a second direction.
 6. The electronic device of claim 5,wherein the processor is configured to: check a wearing state of each ofthe first external electronic device and the second external electronicdevice; and display information on the wearing state through thedisplay.
 7. The electronic device of claim 2, wherein the processor isconfigured to: receive the first audio data through a firstcommunication link established with the first external electronicdevice; and receive the second audio data through a second communicationlink established with the second external electronic device.
 8. Theelectronic device of claim 2, wherein the processor is configured to:receive the first audio data from the first external electronic devicethrough a first communication link established with the first externalelectronic device; and receive the second audio data from the secondexternal electronic device using the first communication link.
 9. Theelectronic device of claim 1, wherein the processor is configured to:confirm a latency between the audio data and the video data, andsynchronize the audio data with the video data based on the latency. 10.The electronic device of claim 1, wherein the processor is configuredto: receive the audio data from each of the plurality of externalelectronic devices using at least one of an extended synchronousconnections (eSCO) communication channel, an asynchronousconnection-less (ACL) communication channel, or a BLE communicationchannel.
 11. A method of operating an electronic device, comprising:establishing at least one communication link with a plurality ofexternal electronic devices; transmitting a first signal indicating anoccurrence of an event using a camera included in the electronic deviceto at least one of the plurality of external electronic devices throughthe at least one communication link; receiving audio data correspondingto sound acquired by each of the plurality of external electronicdevices, from each of the plurality of external electronic devices inpredetermined time periods through the at least one communication linkin a state in which the plurality of external electronic devices areworn; and synchronizing the audio data with video data acquired usingthe camera and storing the synchronized audio data, based on time and anorder at which each of the plurality of external electronic devicesacquires the sound.
 12. The method of claim 11, wherein the receiving ofthe audio data comprises: receiving first audio data corresponding tofirst sound acquired by a first external electronic device among theplurality of external electronic devices and second audio datacorresponding to second sound acquired by a second external electronicdevice among the plurality of external electronic devices; and acquiringstereo audio data using the first audio data and the second audio data.13. The method of claim 12, wherein the receiving of the audio datacomprises: sequentially receiving the first audio data in apredetermined first time period and the second audio data in apredetermined second time period.
 14. The method of claim 13, furthercomprising: transmitting a first ACK signal to the first externalelectronic device in the predetermined first time period when the firstaudio data is received; and transmitting a second ACK signal to thesecond external electronic device in the predetermined second timeperiod when the second audio data is received.
 15. The method of claim12, further comprising: checking a wearing state of each of the firstexternal electronic device and the second external electronic device;and displaying information on the wearing state through the display.